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^5 (5*^ Abstract: System and sensor (10) for imaging characteristics of an object (2). The sensor comprises at least a first area (11) 
and a second area (12) of pixel elements arranged to absorb electromagnetic radiation from the object (2) and to convert the radiation 
^5 absorbed into electrical charges. The first area (11) has a first degree of resolution and the second area (12) has a second degree of 
^ resolution different from the first degree of resolution and the first area (11) is arranged to image one type of characteristics and the 
second area (12) is arranged to image another type of charactmstics. 
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ARRANGEMENT IN A MEASURING SYSTEM 
TECHNICAL RELD 

The present invention relates in general to a sensor and a system for imaging 
characteristics of an object and relates in particular to a sensor and system for 
5 imaging multiple characteristics of an object with different degrees of resolution. 

PRIOR ART 

Conventional imaging sensors of the charge coupled device (CCD) and comple- 
10 mentary metal oxide semiconductor (CMOS) type have an NxM matrix (array) 
with photodiodes, which absorb electromagnetic radiation and convert this into 
electrical signals. 

There is often a requirement for imaging multiple characteristics of the same 
15 object, such as various three-dimensional (3D) and two-dimensional (2D) char- 
acteristics. In the 3D Image geometrical characteristics such as width, height, 
volume etc. of the object are imaged. In the 2D image characteristics such as 
cracks, structural orientation, position and Identity are imaged, for example, 
through marks, bar code or matrix code. Intensity information in the 2D image 
20 is usually imaged in grey scale, but imaging the 2D image in colour, that is to 
say registering R (red), G (green) and B (blue) components, for example, by 
means of filters or light wavelengths is also common, 

A matrix array picture processor (MAPP sensor) Is used for imaging different 
25 characteristics of the same object using the same sensor, so-called multisensing, 
by using a part of the sensor for laser profiling (3D measurement) and Individual 
sensor rows for reading out intensity information (2D measurement). An ad- 
vantage in. using one sensor to Image multiple characteristics is that the cost and 
complexity of the system are less than when using one sensor for the 3D 
30 measurement and another sensor for the 2D measurement, for example. 

In multisensing, the same resolution is nowadays used for lateral measurement 
both In the 2D measurement and in the 3D measurement. It is usual, however, 
to require a higher resolution on the 2D image than on the 3D image. The rea- 
35 son for this is the desire to be able to measure finer detail in the image than is 
required in measurement of the shape. An example of this is timber inspection. 
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where it is often more important to measure cracks and surface structure with a 
higher resolution than the geometric shape. 

Examples of imaging sensors which have different degrees of resolution are 
5 shown In Allreza Molnl "Vision chips", Kluwer Academic Publishers, page 143- 
146, 2000, In which Image sensors are constructed as an electronic eye, that is 
to say they have a high resolution in the centre and a low resolution at the 
periphery. The pixel geometry in these "eyes" Is linear-polar or log-polar. If the 
"eye" sees something interesting at its periphery with a low resolution, the 
10 system can control the sensor so that it directs its high-resolution centre part to 
the area in order to read the details. This type of sensor is very well suited for 
robot applications. An example of such an electronic eye is also shown in US 
5,166,511. 

15 Another example of an imaging sensor which has different degrees of resolution 
is shown in US 6,320,618, in which an array matrix-type sensor has been pro- 
vided with at least one area having a higher resolution than the rest of the sen- 
sor. The sensor is placed in a camera, which is mounted on a vehicle as a part of 
an automatic navigation system, which controls functions of the vehicle, for ex- 

20 ample braking if some obstacle appears In front of the car or steering along the 
white line at the edge of the road. The sensor is arranged to pick up remote in- 
formation with a high resolution and Information In proximity to the vehicle with 
a low resolution. 



25 SUMMARY OF THE INVENTION 

An object of the present Invention is to provide a sensor and a system which im- 
age the characteristics of an object with different degrees of resolution. This has 
been achieved by a sensor and a system having the characteristics specified in 
30 the characterising parts of claims 1 and 9 respectively. 

One of the advantages to the use of a sensor and a system which read in multi- 
ple characteristics images with different degrees of resolution is that a simpler, 
cheaper and more compact solution is obtained than with previously known so- 
35 lutions. A system according to the invention furthermore requires fewer system 
components such as cameras, lenses etc. 
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According to one embodiment of the present invention the sensor comprises two 
integral areas with pixels which are arranged substantially parallel, side by side 
in a transverse direction. 

5 According to another embodiment of the invention the two areas with pixels are 
designed as two separate units, which are arranged substantially parallel, side by 
side In a transverse direction 

According to a further embodiment of the Invention the two pixel areas/units 
10 share read-out logic, which means that they have the same output register. 

According to an alternative embodiment of the invention the two pixel 
areas/units are each read out on different output registers, which means that it 
Is possible to read out the information contained in the two areas/units simulta- 
15 neously. One advantage to this is that it obtains greater freedom with regard to 
exposure times. Another advantage is that it obtains greater freedom with re- 
gard to degrees of resolution in both the transverse direction and the lateral 
direction. 

20 BRIEF DESCRIPTION OF THE DRAWINGS 

The Invention will now be explained In more detail on the basis of examples of 
embodiments and with reference to the drawings attached in which: 

25 Fig 1 shows a perspective view of a measuring system according to the 
present Invention; 

Fig 2 shows a three-dimensional profile and intensity proHle of an object 
imaged on the sensor; 

30 

Fig 3 shows a first embodiment of a sensor according to the invention; 

Fig 4 shows a second embodiment of a sensor according to the invention; 

35 Fig 5 shows an alternative embodiment of a sensor according to the 
invention; 



illustrates a fundamental system setup according to a first 
embodiment; 
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Fig 7 



illustrates a fundamental system setup according to a second 



embodiment. 



DETAILED DESCRIPTION OF EMBODIMENTS 

5 

Figure 1 shows a system for reading In characteristics of an object. The system 
comprises a camera 1, which may be an MAPP camera, a CCD camera, a CMOS 
camera or any other camera suitable for imaging characteristics of an object. 
The system furt:her comprises an object 2, the characteristic-dependent para- 

10 meters of which are to be measured by the system, placed on a base 3 together 
with two light sources 4 and 5 arranged to illuminate the object 2, The light 
sources 4, 5 generate, for example, substantially point light, substantially linear 
light or light composed of multiple, substantially point or linear segments and 
may be of any type suited to the application, for example lasers, LED's, ordinary 

15 light (light bulb) etc, but these are familiar to the person sicilled in the art and 
will not be further described here. 

The camera 1 comprises, among other things, a sensor 10, which is shown in 
Figures 2 to 5 and is described in more detail below, light-gathering optics and 
20 control logic (not shown). The rays reflected from the object 2 are picked up by 
the sensor 10 and are converted there into electrical charges, which are in turn 
convert:ed Into analog or digital electrical signals. In the preferred embodiment 
these signals are then transferred via an output register (shown In Figures 6 and 
7) to an Image/slgnal-processing unit (not shown) to be analysed and processed. 

25 

The object 2, which as stated above, has been placed on the base 3, which in a 
preferred embodiment moves relative to the measuring system Indicated by an 
arrow in the figure. Instead of the base 3 moving relative to the measuring 
system, the relationship may naturally be reversed, that is to say the object 3 is 
30 fixed and the measuring system moves over the object 2 when measuring. The 
base 3 may be a conveyor belt, for example, or alternatively there is no base and 
the object itself moves, if the said object is paper, for example, in a continuous 
web in a paper-making machine. 

35 In an alternative embodiment (not shown), one or more of the light sources is 
located below the base 3 and shines through the object 2, which means that the 
sensor 10 picks up transmitted rays which have passed through the object 2, 
and not reflected rays. 
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In Figure 1 the direction of movement is indicated by an arrow. This direction 
will be referred to in this document as the transverse direction, that Is to say Y In 
the system of coordinates drawn into the figure- The lateral direction (X In the 
system of coordinates) lies perpendicular to the transverse direction. In meas- 
5 uring there is a transverse and a lateral resolution. The transverse resolution 
depends on how frequently the object 2 is read off (sampled). The present in- 
vention is primarily concerned with the lateral resolution, which largely depends 
on the number of pixels which the sensor 10 has In a row. 



10 The sensor 10 (shown in Figures 2 to 5) Is an array sensor and has a first area 
11 with NxM pixels (where N Is rows and M is columns) combined with a second 
high-resolution area 12 with XxY pixels, where Y=Mxb (b is an integer >1). In 
the preferred embodiment the first area 11 is used for 3D measurement by trl- 
angulation, that Is to say imaged geometric characteristics of the object 2 such 

15 as width, height, volume etc. In 3D measurement, the intensity Image is re- 
duced from k rows, k>l, to the position values that correspond to where the 
light strikes the sensor in each column. The result is a profile with three-dimen- 
sional information for each sample of k rows. In the preferred embodiment the 
second area 12 Is used for 2D measurement (Intensity Information), that Is to 

20 say in imaged characteristics of the object 2 such as cracks, structural orienta- 
tion, position etc. If X ^ 2, there is a possibility of applying colour filters (for 
example, RGB) to the individual pixels and in this way obtaining a colour read- 
out of 2D data. 



25 Figure 2 shows a 3D profile of the object 2 in the first area 11 and a grey 
scale/colour Image of the object 2 in the second area 12. The object 2 Is 
scanned profile by profile as the object 2 passes the measuring system and the 
result Is accordingly a three-dimensional and a two-dimensional imaging of the 
object 2. 

30 

In the preferred embodiment an MAPP sensor is used, but the person skilled in 
the art will appreciate that the invention may be applied to other types of sen- 
sors, such as CCD sensors or CI^OS sensors, for example. 

35 Figure 3 shows a first embodiment of the sensor according to the invention. 
Here the pixels in the second area 12 are one third the width of the pixels in the 
first area 11. If there are 512x1536 pixels in the first area 11, for example, the 
second area 12 then has 16x4608 pixels (b=3), for example. This means that 
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up to 512 rows are used for the 3D measurement and triple resolution Intensity 
components are read out on up to 16 rows. 

In the embodiment according to Figure 4 every other row in the second high- 
5 resolution area 12 is offeet half a pixel width In relation to the rows immediately 
below and above. The second area 12, according to the example for Figure 3, 
then has 8x3072 double rows of pixels (b=2), In which a double row consists of 
two single rows and one row is offset by half a pixel width. This means that in 
the embodiment according to Figure 4 up to 512 rows are used for 3D measure- 
10 ment and up to 8 different double-resolution intensity components are read out. 

The person skilled in the art will appreciate that the Invention is not limited to 
the embodiments shown in Figures 3 and 4. There Is an almost infinite number 
of variants of how the pixels can be formed in the high-resolution second area 
15 12. For example, the pixels may be half the width of those in the first area 11, 
or also at the same time twice as high etc. Other variants of the embodiment 
according to Figure 4 may involve the pixels being offset by a third or a quarter 
of the pixel width. With regard to this, see also US 4,204,230, which shows off- 
set pixel rows for increasing the resolution of an imaging sensor. 

20 

According to Figures 3 and 4 the first area 11 and the second area 12 lie sub- 
stantially parallel side by side in direct contact in a transverse direction, that it to 
say the sensor is manufactured as an integral unit. Figure 5 shows an alterna- 
tive embodiment in which the first area 11 and the second area 12 are two 
25 separate units lying substantially parallel side by side in the transverse direction, 
but not in direct contact. In Figures 2 to 5 the second high-resolution area 12 is 
located transversely In front of the first area 11 (illustrated at the top of the fig- 
ures), but naturally it may equally well be located transversely behind the first 
area 11 (illustrated at the bottom of the figures). 

30 

An alternative to designing the pixels offset in relation to one another is to cover 
the pixels with masks, which are arranged in such a way that illumination of 
parts of pixels is blocked and an offset sampling pattern is thereby obtained. 

35 A sensor row is read out to an output register, which is 1^ pixels long, shown in 
Figures 6 and 7. This output register 15, 18a, 18b is either exchanged as raw 
data or it is coupled to a row-parallel A/D converter and/or signal/image proc- 
essing unit. In order to read out a Y-wide row, w read-outs must be performed 
successively. If the output register 15, 18a, 18b has space for b rows, these can 
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be read out/processed together. The read-out can therefore be both analog and 
digital, but in the preferred embodiment of the present invention (shown in Fig- 
ure 6), measured data is read out via an A/D converter 16 and a processor 17 to 
a digital output register 15, before being relayed to an image-processing unit 
5 (not shown). 

The processor 17 can be programmed to perform many functions, among other 
things extracting the three-dimensional profile from the intensity image, that is 
to say each column calculates the position of the lightest point and these values 
10 can then be seen as an intensity profile in which the intensity corresponds to 
distance. Other functions performed by the processor 17 are edge. detection, 
noise reduction etc. 

In an alternative embodiment of the invention, shown in Figure 7, the two sensor 
15 areas 11, 12 (Nxl^ and XxY) do not share the read-out logic, that is to say they 
have different output registers 18a and 18b, which means that other effects are 
obtained. Information from the two areas 11, 12 can be read out Independently 
of one another with greater freedom of exposure times and degrees of resolution 
both in the transverse and in the lateral direction. Furthermore, Y=Mxb need not 
20 apply, it being instead possible to configure the geometries differently, for ex- 
ample a 1536x512 matrix could be combined with a 4096x3 matrix. In a pre- 
ferred embodiment of the alternative embodiment shown in Figure 7, measured 
data are read out via A/D converters 19a, 19b and processors 20a, 20b to digital 
output registers 18a, 18b. 



25 



Both of the embodiments according to Figures 6 and 7 are Illustrated with A/D 
converters and processors. These should only be regarded as preferred em- 
bodiments. It is quite possible, as briefly mentioned above, to output measured 
data directly as analog or digital raw data from the output registers. 



30 



As stated above, it is possible to use colour filters or coloured light sources (not 
shown) on the second area 12 of the sensor 10, which means that both grey 
scale and colour images can be read out with the higher resolution. Which col- 
our filters or coloured light sources are used and how these are placed will be 
35 known to the person skilled in the art and will not be described in detail here, 
but the possible use of Bayer patterns or a filter for each row may be mentioned 
by way of example. RGB components are commonly chosen, but other colours 
such as CMY (cyan magenta yellow) may also be used. In the alternative 
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embodiment according to Figure 7, eacii colour might have its own output reg- 
ister, which gives a faster read-out of each colour profile. 

Crosstall< means that light from one measurement interferes with another sensor 
5 area, that Is to say light from the 3D measurement Interferes with the 2D meas- 
urement and/or vice-versa. In order to reduce the crosstall< between different 
sensor areas It is possible to separate the light to these into different wave- 
lengths and to protect different sensor areas with optical filters differing accord- 
ing to wavelength, which blocic the light or allow It to pass through to the re- 
10 spective sensor area. 

In yet another embodiment of the sensor 1 according to the invention time delay 
integration (TDI) is used on the high-resolution second area 12. TDI means that 
the charge is moved from one row to another as the object 2 is moved with the 
15 base 3, thereby achieving an X-times greater light sensitivity with X TDI stages. 
By using TDI in the embodiment according to Figure 4, the charge will be moved 
by two rows per stage since intervening rows are offset by half the pixel width. 
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CLAIMS 



5 



10 

2. 



15 

3. 



20 4. 



25 

5. 



6. 

30 



Sensor (10) comprising at least a first area (11) and a second area (12) of 
pixel elements arranged to absorb electromagnetic radiation from an 
object (2), the characteristics of which are to be imaged, and to convert 
the radiation absorbed into electrical charges, In which the first area (11) 
has a first degree of resolution and the second area (12) has a second 
degree of resolution different from the first degree of resolution, 
characterised in tliat the first area (11) is arranged to image one type of 
characteristics and the second area (12) Is arranged to Image another type 
of characteristics. 

Sensor according to Claim 1, characterised in that the first area (11) is 
arranged to image three-dimensional characteristics of the object (2) and 
that the second area (12) is arranged to image two-dimensional 
characteristics of the object (2). 

Sensor according to Claim 1, ciiaracterised in tliat at least one of the 
two areas (11, 12) is provided In its entirety or partially with colour filters 
in order to image the object (2) in colour. 

Sensor according to any one of Claims 1 to 3, characterised in tliat the 
first area (11) Is designed as a matrix having N rows and M columns, that 
the second area (12) Is designed as a matrix having X rows and Y columns 
and that Y is b multiplied by M columns, where b is an Integer greater 
than zero. 

Sensor according to Claim 4, ciiaracterised in tliat time delay integration 
(TDI) Is used on the second area (12). 

Sensor according to Claim 1, characterised in that at least one of the 
areas (11, 12) is provided with filters for different wavelengths in order to 
minimise crosstalk. 



7. 

35 



Sensor according to Claim 1, characterised in that the first area and the 
second area are arranged parallel in a transverse direction as one Integral 
unit. 
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8. Sensor according to Claim 1, characterised in tliat the first area and the 
second area are arranged parallel in a transverse direction as two separate 
units. 



5 9. System for measuring character-dependent parameters of an object (2) 
comprising at least one light source (3, 4), which emits light towards the 
object (2) characterised in that the system further comprises a sensor 
(10) according to any one of Claims 1 to 8, arranged to absorb electro- 
magnetic radiation from the object (2) and to convert it into electrical 

10 charges. 

10. System according to Claim 9, characterised in that the system also 
comprises an output register (15) arranged to read out the charges 
received in the sensor (10). 

15 

11. System according to Claim 9, characterised in that the system also 
comprises at least two output registers (18a, 18b) arranged to read out 
the charges received in the sensor (10). 

20 12. System according to Claim 11, characterised in that the first area (11) 
and the second area (12) of the sensor (10) are each read out on their 
own output register (18a, 18b). 

13. System according to Claim 11, characterised in that If the second area 
25 (12) of the sensor Is provided with colour filters, each colour picked up has 

Its own output register. 

14. System according to Claim 10 or 11, characterised in that the system 
further comprises an A/D converter (16) arranged to convert the electrical 

30 charges from an analog to a digital format and that the output register 

(15, 18a, 18b) is a digital output register. 

15. System according to Claim 9, characterised in that the system also 
comprises an image/signal processing unit arranged to analyse the 

35 electrical charges. 
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